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Assessment Highlights 


The Department of Veterans Affairs (VA) engaged Grant Thornton to assess four strategic options for modernizing its Electronic 
Health Record (EUR) 


Option 1: COTS 

• Adopting a Commercial-of-the-shelf (COTS) product where VA hosts the solution in a VA purchased, federally certified, 
secure cloud environment 

Option 2: COTS + 

• Adopting a COTS product with Electronic Health Management Platform (eHMP) and the Joint Legacy Viewer (JLV); VA 

eHMP / JLV 

hosts the solution in a VA purchased, federally certified, secure cloud 

Option 3: 

• Providing a gold standard VistA version to a vendor to modernize and provide back to VA as a Software as a Service 

Commercialized 

Vista 

(SaaS), where the vendor hosts the solution in a federally certified, secure cloud, and provides discounted licensing 

Option 4: COTS 

• Adopting a COTS product for the EHR where the vendor hosts the solution in a federally certified, secure cloud, and VA 

SaaS 

licenses software use 


Highlights from the Assessment: 

• The market does address VA’s EHR needs with limited variability in cost across the four options 

• Key differentiators between the options include the benefits of software ownership, and degree of influence and autonomy VA can 

exercise in EHR development and data access 

• The strategic choice will need to balance VA's appetite for risk against the benefits, costs and strategic alignment 

- Option 3 (Commercialized VistA) is the least expensive option but carries the greatest risk in appropriate and willing available 
vendors (e.g., maturity of vendor, economic return) 

- Option 2 (COTS + eHMP/JLV) is the most expensive option and is less aligned with OI&T’s strategic priorities (e.g., buy first, 
reduce IT footprint), yet can enable tailoring 

- Option 1 (COTS) and Option 4 (COTS SaaS) cost the same and primarily vary in (a) the control and flexibility VA will have to 
integrate new solutions as they emerge in the market, (b) the responsibility for hosting, which requires IT investment and skills 
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Trade-off Analysis — Clinical Summary 


COTS vendors provide modern systems that meet multiple interoperability standards. VA retains more flexibility for future applications 
when it owns and administers the cloud; and, has the highest degree of tailorability when it designs all or part of the software. The 
relative importance of these criteria inform the strategic decision. 


Decision 

Factor 

Option 1: COTS 

Option 2: COTS + eHMP 

Option 3: Commercialized 
VistA 

Option 4: COTS SaaS 

Interoperab 
ility with 
other health 
systems 

• Top tier vendors meet multiple 
interoperability standards (e.g., 
FHIR) to create longimdinal 
record 

• Same as Option 1: COTS. 
Also,JLV provides a static 
view of external records 

• efIMP to provide longimdinal 
record 

• Capability would be built 
into the commercialized 
VistA solution 

• Top tier vendors meet 
multiple interoperability 
standards (e.g., FHIR) to 
create longimdinal record 

Modernity 

• Leading software that upgrades 
with industry best practices and 
innovation; includes modern 
team based communications 

• Same as Option 1: COTS 

• eHMP functionality would 
need to be de-conflicted of 
overlapping capability and 
then integrated with the 

COTS product 

• Vendor’s commitment to 
continuous upgrade 
contingent on ability to sell 
into the market 

• Same as Option 1: COTS 

Flexibility 

• VA administered cloud 
increases VA flexibility to 
access 3rd party vendors (e.g., 
best in class population health) 
and data 

• Same as Option LCOTS 

• eHMP for new capabilities 
developed over time which 
may exceed pace that market 
innovates 

• Vendor administered cloud 
decreases VA flexibility to 
access 3rd party vendors 
(e.g., best in class 
population health) as 
vendors may have pre¬ 
existing agreements. 

• Vendor administered cloud 
decreases VA flexibility to 
access 3rd party vendors 
(e.g., best in class 
population health) as 
vendors may have pre¬ 
existing agreements. 

Tailorabilit 

y 

© 20'7 Grant Thornton LLP 

• Software configuration to meet 
end-user practice preference 
(e.g., physician note templates) 

• Code level change 
(customization) incurs 
additional cost 

• Same as Option LCOTS 

• eHMP adds capabUity to 
tailor because it is a VA 
developed and managed 
product 

• Highest level of tailorability 

• May require additional cost 
to purchase leading 
business and clinical 
workflows from 3rd party 
entities 

• Same as Option 1: COTS 
except code level change 
(customization) may not be 
possible due to shared 
software with other clients 
(e.g., DoD) 4 
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Trade-offs Analysis — Technology, Time, Risk & Cost 


COTS solutions carry less risk as they are routinely implemented and run in the market, both on and off premises. More extensive 
tailoring increases cost or time for implementation. While Options 3 and 4, meet all IT priorities, they trade off some flexibility for VA in 
choosing downstream applications. 


Decision 

Factor 

Option 1: COTS 

Option 2: COTS + eHMP 

Option 3: Commercialized 
VistA 

Option 4: COTS SaaS 

IT Strategic 
Alignment 

• Aligns with all the strategic 
priorities except cloud is 

VA administered 

• Does not align with the 
following strategic priorities: 
buy first, reduce IT footprint 
because eHMP is VA 
developed 

• Ahgns with all IT priorities 

• Ahgns with all IT priorities 

Time to Initial 
Operating 
Capability 
(IOC) 

• Out-of-the-box 
functionalities fulfilling 
>80% of VA’s needs 

• Estimate 18-24 months to 
IOC ~ Pilot Site post 
acquisition 

• Out-of-the-box 
functionalities fulfilhng >80% 
of VA’s needs 

• Addidonal time to re-design 
and scale eHMP to COTS 

solution 

• Estimate 18-24 months to 

IOC ~ Pilot Site post 
acquisition** 

• Requires modernizing a 
single instance of VistA 
software prior to 
implementing, which wiU 
add at minimum an 

additional 12 months 

• Estimate 24-36 months to 
IOC ~ Pilot Site post 
acquisition 

• Out-of-the-box 
functionahties fulfilling 
>80% of VA’s needs 

• Estimate 18-24 months to 
IOC ~ Pilot Site post 
acquisition 

Relative Risk 

• Medium risk since vendors 
implement their solutions 
in tliis manner routinely 

• Higher risk due to continued 
rehance on internally 
developed software 

• High risk due to limited 
partner viability or appetite 

• Medium risk since vendors 
have SaaS models in place 

15-Yeat Cost 

Estimate* 

$16,234,994,160 

$18,740,799,583 

$11,992,747,674 

$16,066,009,238 


*15-Year Cost Estimate contains the 10 year implementation timeframe, plus five years of post-implementation 
sustainment. 

**el IMP re-design and scaling effort may increase time to IOC. 
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Next Steps 


We recommend the following next steps: 

• Facilitated discussion with VA leaders to vahdate and prioritize decision criteria and evaluate against success at 
year 1 and year 10. 

Clinical / Operational: 

• Formally document and prioritize desired EHR capabilities clinicians would like to sec in the next 3-5 years in 
a modernized EHR (e.g, video conferencing capabilities with Veteran on her PDA, receiving Veteran's vitals 
remotely before he arrives to the cUnic) 

• Establish a communications strategy that includes the design of a communications infrastructure that 
proactively anticipates and addresses internal and external concerns to maximize cooperation and understanding 

Technology: 

• Conduct a technical readiness assessment that includes testing VA's network infrastructure, bandwidth and 
other technical capabilities to support the technology requirements of a modernized EHR system either in a cloud 
or SaaS environment 

• Conduct a system (application) and hardware inventory including end-user devices such as computers, tablets, 
etc. across each and every clinical location to ensure all software and hardware is catalogued to evaluate future plans 
(upgrade, maintain or decommission) and understand interface requirements with the new EHR 
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Summary of Qualitative Findings 


The four strategic options have differentiated benefits, risks and alignment with IT strategic priorities. VA must assess the relative value 
places in these strategies and benefits, and the relative importance of each risk in identifying the optimal solution. 


Evaluation Factors 

Option 1: COTS 

Option 2: COTS + 
eHMP 

Option 3: 
Commercialized 

VistA 

Option 4: COTS 
SaaS 

Clinical Priorities 

• 

• 

• 

• 

IT Strategic Direction 


c 

• 

• 

Benefits 






High 

High 

High* 

High* 

Risk 

Medium 

High 

High 

Medium 


*Rating assumes VA inserts appropriate language into the contract to guarantee access to and control of data as well as ability to 
connect third-party software at wiU. This may increase cost to VA. 
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Strategic & Cultural Fit 


Review of multiple EHR vendor product demonstrations suggested that COTS vendors have current capabilities within their out-of-the- 
box functionalities to meet majority if not all of VHA's clinical priorities. 


Clinical Priorities 

Option 1: COTS 

Option 2: COTS -H 
eHMP 

Option 3; 

CommerciaUzed VistA* 

Option 4: COTS SaaS 

Addresses features unique to VA 

• 

• 

• • 

Workflow 

• 

• 

• • 

Team-based care 

• 

• 

• • 

Analytics and research 

• 

• 

• • 

Mental health 

Interoperability with DoD and 
community providers 

• • 

• • 

• • 

• • 


^ PaHial 

O Nril 

*Assumes the modernized, Commercialized VistA is based on a single, "best of breed" instance of VistA. 


CampJctc 
I I -wnirf I 
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Functionality & Technology 


Options 1, 3, and 4 almost fully align with VA’s IT strategic direction. Option 1 (COTS) has some reliance on existing IT resources to 
support the hosting semp. Option 2 (COTS + eHMP) on the other hand, has limited alignment primarily because it relies heavily on VA 
resources for the hosting setup and also for the internal development to support and advance the eHMP. 


Technology Priorities 

Option 1: COTS 

Option 2: COTS + 

Option 3: 

Option 4: COTS SaaS 



eHMP 

Commerciahzed VistA 


Single-view of the Veteran and data 
management 

• 

• 

• • 

Strategic sourcing 

• 

1 

• • 

Buy-flrst approach 

• 

€ 

• • 

Reduced IT footprint 


C 

• • 

Cloud-hased 

• 

• 

• • 

Additional Evaluation Criteria 





Network resource requirements 

• 

C 

• • 

Adaptability 

• 

• 

• 

i) 

Scalability 

• 

c 

• 

• 

Redundancy 

• 

€ 

• • 
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Benefits 


The relative value of each benefit to VA leadership is a critical dimension to assessing each option against one another from a benefits 
perspective. While it may be natural to simply tally highly rated benefits, they may not hold the same importance to VA. Each benefit and 
option must be assessed individually as well as collectively to understand how they drive the decision. 


Benefit Category 

Evaluation Criteria 

Option 1: COTS 

Option 2: COTS + 
eHMP 

Option 3: 
Commercialized 

VistA 

Option 4: COTS 
SaaS 

Defined product roadmap 

• Clear vision for software 

evolution 

• Ability to keep pace with 
market demands, trends 
and innovations 

High 

Medium 

Low 

High 

Access to and ownership 
of data 

• VA has direct 

administrative and/or 
system authority 

High 

High 

Low* 

Low* 

High* 

High* 

Ability to customize EHR 
product 

• VA has the ability to direct 
product development 

Medium 

High 

High 

Low 


*This benefit is traditionally low as the vendor controls the environment in which the software is hosted, and can therefore control how and whether 
other systems can connect. VA can mitigate this however, by ensuring appropriate language in the contract guaranteeing ability to connect software of 
VA's choosing. This may add cost to VA. 
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Risks 


Similarly to the benefit analysis, it is important not to simply tally the assessed risks, but to analyze each risk separately to understand the 
relative importance of the risk and whether it is an acceptable risk for the agency to take. These risks can then be balanced against 
alignment with strategy, benefits and costs to find the best strategic option for VA. 


Risk Category 

Evaluation Criteria 

Option 1: COTS 

Option 2: COTS + 
eHMP 

Option 3: Comm. 
VistA 

Option 4: COTS 
SaaS 

Transitioning to a cloud 
environment 

• Experience with cloud 

• Resource skiUset 

High 

I Iigh 

High 

Medium 

Backup and disaster 
recovery management 
(DRM) 

• Infrastructure reliability 

• Redundancy protocols in place 

High 

High 

Low 

Low 

Integration of third-party 
COTS applications 

• COTS capabilities can address 
V^HA's needs (e.g., population 
health, mental health) 

Low 

Low 

Medium 

Medium 

Loss of control over future 
EHR capabilities 
development* 

• VA's level of autonomy and 
control over its future EHR 
solution 

High 

Medium 

Low 

High 

Medium 

Medium 

Demand on network 

infrastructure 

• Relative bandwidth requirement 
at the VAMC and satellite 

facilities 

Medium 

High 

Medium 

Medium 

Required additional 
development 

• Maturity of software and its 
capabilities 

Low 

High 

High 

Low 

Disruption to workflow 
during implementation 

• Clinical workflows and business 
processes will be redesigned 

High 

High 

High 

High 

Availability of Vendors 

• The known availability of vendors 
in the market that can support the 
option 

Low 

Low 

High 

Low 


^Traditionally, this risk is high as commercial vendors control the product roadmap. VA however could reduce this risk by contractually requiring some 
control over the direction the vendor takes with the product. The additional control would likely incur additional costs for VA. 
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Assumptions 


General Assumptions 

• EHR will be implemented in a Digital Health Platform 
environment that enables interoperability among disparate 
systems and devices. 

• The following cost categories have been excluded from the cost 
analysis: 

Decommissioning of VistA 

Internal VA/VHA/OI&T staffing costs 

• VA will not buy additional or specialized hardware for EUR 
implementation. 

• Assessment is based on strategic needs, not detailed functional 
and non-functional requirements. 

• Industry benchmarks related to EHR adoption apply: 

Healthcare Financial Management Association (HFMA) 
cost breakouts are generally applicable with some VA- 
specific modifications due to less hardware need. 

• COTS vendors are aU willing to configure their products to meet 
VA's enterprise needs. 

• VA win maintain ownership of all clinical data related to Veteran 
healthcare. 

• All cloud providers, whether VA provisioned or SaaS, are HIPAA 
and FEDRamp High compliant. 
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Option-Specific Assumptions 


• Option 2: eHMP can be made to be compatible with a COTS 
solution. We assume that the future eHMP will possess 
functionality lacked by COTS solution. 
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Guiding Principles 


Business Principles 

• Veteran safety and quality care are not 
compromised during EHR transition. 

• A modernized EUR supports Veteran¬ 
centric, quality-driven, data-driven, 
evidence-based, and team-based care. 

• Clinical priorities drive EUR functional 
needs. IT trends and disruptive 
innovations can enable/inform EHR 
system functions. Requirements are 
driven by stakeholder principals (e.g., 
clinician, researcher, care team). 

• EHR standardization is balanced with 
managed configurability. 

• A modern EHR is adaptive to current 
and fumre health care trends, as well as 
IT/digital transformation trends. 

• EHR incorporates integrated (across care 
settings, e.g., surger)', operating room, 
emergency dept., intensive care, 
outpatient clinics, inpatient, long-term 
care, mental health, virtual care 
modalities) and longitudinal view of 
Veteran data. 

• Decisions are optimized for VA and 
achieve economies of scale. 

• Innovation and agility are non- 
negotiable. 

® 2017 Grant Thornton LLP 

Al rights reserved. U.S. member firm of Grant Thornton Internattonal Ltd. 


Operational Principles 

• Change management, standardization of 
clinical processes (including business 
process reengineering) and data are 
critical to the success of EHR 
modernization. 

• EHR modernization is minimally 
disruptive to hospital and clinic 
operations. 

• Legacy VistA EHR represents the 
baseline. Consequently, clinical 
excellence cannot regress as a result of 
IT changes during EHR modernization. 

• VA leverages EHR lessons and best 
practices from organizations with similar 
delivery models (e.g., Kaiser, DoD, Mayo 
Clinic). 


Architecture /Engineering Principles 

• EHR systems are architected from a 
system-of-systems perspective, 
optimizing system quality (e.g., reliability, 
scalability, maintainability, usability, etc.). 

• EHR system should promote open 
architecture and standards so that clinical 
tools remain available to public and 
private sector providers. 

• In addition to standardized business 
processes, EHR will incorporate 
common data/information model, 
taxonomy and standardized 
terminologies. 

• Data is an asset. Data integrity and 
quality are always sustained. There is 
zero tolerance for data loss during 
transition to a modern EHR system. 

• EHR is designed and implemented to 
enhance seamless interoperability with 
DoD and community providers, and 
establish collaborative partnerships. 




Analysis Framework & Approach 


In evaluating the four strategic options, Grant Thornton leveraged our strategic evaluation framework for adoption of new enterprise 
technologies, which is comprised of Strategic Fit and Culture; Functionality and Technology; and Cost/Schedule and Viability 
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Reviewed industry and scholarly journals and publications, published 
\'A and VisL\ related studies and assessments, VA strategy information 
and Congressional Testimony, and conducted an environmental scan to 
identify clinical care and health IT trends. 



Held meetings with Cerner, Epic, athenahealth, and iCare commercial 
EUR vendors to determine alignment with clinical and IT priorities, 
assess implementation and carrying costs, and elicit implementation 
thoughts. 



Collaborated with MITRE to interview 10 OI&T and 20 VIL\ 
stakeholders, including OI& T leadership, developers and maintainers, as 
well as VI lA leadership, physicians, nurses, specialists, data analysts and a Care 
in the Community executive. 



Developed cost models based on GAO analogous costing 
methods and industry benchmarks for EHR implementations. 
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VHA and OI&T Stakeholder Analysis 


Clinical 


Technology 


Communication and Coordination Tools ate Necessary 

• VHA representatives articulated a need for better communications tools to support 
care coordination among the care (PACT) team, with community providers and 
with Veteran patients. 

Analytics and Measurement 

• The general feedback is that VistA provides an excellent capability for enterprise 
analytics, but at the chnician level does not provide the capabihty to perform data 
analysis to support care dehvery. 

Organizational Readiness 

• While chmcians personally expressed eagerness for a change, they are concerned 
with organizational preparedness and capabihty to manage the change to a new 
system. 

Culture 

• Chnicians expressed satisfaction with the level of customization locally with VistA, 
which is not possible with a new system. 

• There is some concern that the change will drive retirement ehgible staff towards 
leaving to avoid having to go through a complex change to a new EUR. 

Package/Specialty Level Concerns 

• Stakeholders expressed need for a solution that meets VA's needs more fully in: 

Pharmacy 

Community Care/Revenue Cycle 

Labs 

Mental Health 


Concerns Regarding Technological Readiness 

• Network Capacity 

• Lack of in-house skills for moving to the cloud 

Ability to Meet VA-Specific Needs 

• COTS solutions will not address Veteran specific 
issues as well 

Solution Must Support Standardization of Care 

• Data management must support care delivery 

• Decision support currently works, but is not 
standardized across the agency 

• Mobile health is critical to success 

• \'eterans must have a central place to manage their 
health 

General Concern with VistA Modernization 

• VA has not invested in Vist.\ as it should have over 
past ten years 

• VA looked to contractors with less experience in 
MUMPS and Vist.\, which made modernization more 
difficult 
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Clinical and Technical Priorities 


Clinical 

Care Approaches Unique to VA 

• Configuration required to address Federal requirements while serving a unique population 
base (e.g., pharmacy, tele-health, mental health) 

Workflow 

• Single location for Veteran information — whether VA or community generated records. 

• Improved tele-health, mobile and web-based tools/technologies for managing Veteran care 

• Scheduling ease for Veterans and providers 

Team-based care / PACT 

• Improved care coordination 

• Improved communication tools 

• Management of Veteran cohorts — supporting Veteran groups with similar health concerns 

Analytics / Research 

• Clinical decision and cognitive analytics support - care for an individual Veteran 

• Population health - leveraging large data sets to improve care for groups 

• Performance improvement - tracking outcomes between facilities/regions 

• Ability to easily access data for clinical and research purposes 

Mental health 

• Seamless integration of mental health into EHR 

Interoperability 

• Seamless bi-directional exchange of data with DoD, community providers, etc. 
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Technology 


Strategic 

• Buy-first approach 

• Cloud-based 

• Reduced IT footprint 

• Interoperable with Visti\, COTS, DoD, community 
providers 

• Data is standardized for management purposes 

• Single-view of Veteran and data management 

• Utilization of strategic sourcing methods 

• Integration with VA cyber-security strategies 

Operations 

• Reduce barriers to improve worker productivity 

• Clinician input in EHR design 

• VA maintains ownership of its data 

• Internal network (LAN) capacity to meet data traffic 

• Broadband (high-speed, high bandwidth) internet 
availability 

• Integration of non-EHR VisL\ components 


17 




Estimated Implementation Timeline 


Grant Thornton selected a ten year implementation timeline due to the size and complexity of VA. This would allowing adequate 
planning and preparation time, as well as time for appropriate alpha and beta testing prior to full roll out. 

Our assumed timeline includes appropriate planning for the following: 

• 12-18 months for preparation, planning and Project Management Office (PMO) stand-up for the implementation 

• Beta test at one facility for the next 12-18 months to deploy the future Health IT/EHR in VA: 

Capture clinical and business requirements and standardize workflows across the facility 
Translate clinical data and design requirements to technical specifications required for build 

- Map standard reporting capabilities to clinical and operational requirements and develop custom reports as appropriate 

Develop a robust testing methodology’ to including testing data flow across vendor and VA applications and outside in the community 

Conduct integrated clinical use case testing, including regression and community connections 

Conduct training of clinical and operational end users 

Determine appropriate support for activation and deployment activities 

• Alpha test for 12-24 months that includes expansion to other facilities in the beta site Veteran Integrated Service Network (VISN), and 
additional facilities in other VISNs to control for VISN variability 

- Confirm lessons learned based from the beta site on clinical adoption and interoperability with community providers utilizing Agile 
methodologies 

- Conduct user review and acceptance analysis of standardized clinical and business processes developed and implemented at the beta test site 

- Determine key drivers for the time duration would be deployment of standardized clinical workflow, training and testing 


• Begin national rollout of the implementation phase. 
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